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(54) Method for providing media content over a digital network 



(57) The present invention relates to a method for 
providing media content to a user over a digital network, 
which media content is provided by a media content 
server, organized and selected by an intermediate node 
in accordance to previously stored user preferences, 
and delivered to a client operated by the user. The meth- 
od is characterized by the steps of defining a personal- 
ized media package structure, communicating a first 
package having said personalized media package 
structure to the client, receiving status information from 
the client, said status information describing a user ac- 



tion, adapting said personalized media package struc- 
ture in response to said user action, and communicating 
a second package having said adapted personalized 
media package structure to the client. 

According to the invention, the user can experience 
a highly personalized media playback, with a minimum 
of costs related to network transmission. By the imple- 
mentation of the status information communication to 
the personalization server, the media package structure 
is continually updated in accordance with the user's con- 
sumer pattern. 
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Technical field 

,„«„ !». prasan, ,n,an«on ,a,a,. S g.n«* » — «- «- <*«— - - "^ <>n am °" 9 
media content, accessed over a data network. ^ providing and receiving media content 

S^S^— . no*, in accordance .0 pr.*u s ly «o»d u~r pre..,enc<*. 

Technical background 

,„g. which n,.ans ,h,i ft. ^"^J^^^Z^ 1h. meola contant dips on. by on. (iuMMI » 

Sn^.on^^™IeW." 

=z rrr2=:«r:r:i « - * - - — - 

mobile Internet has increased. th#1 ,^ er utj | izes a handheld device that normally is not connected to the network. 

[0005] According to af.rst approach, the user ut a ^^ dn usj docking equipment of some kind. An ex- 

Ltead, the device is connected sporadically to witl ? a Pa .m Pilot device. The user initiates an 

ample of this approach is the AvantGo system, "P*^*™**^^ ne/sne would like information from. This 
account at the AvantGo server, and selects ^^ZZT^L<i to the AvantGo server and continual* 
information, which has a special "^^^V^^*^^^^ js downloaded to the Pa.m Pilot. Then, with 
updated. Each time the user docks the ^^.^^^^o the downloaded pages, for examp.e during 
the Palm Pilot disconnected from the network the ^user ^ of ^ namics and me dia quality. Firstly, as 

a bus ride home. Obviously, this approach has s ^"°^ e c r an not £ chan ged. Secondly, the media infor- 
so the device is not connected during brows.ng the mf ~ ^cUng procedure and to be sufficiently 

rrts-r^ 

on the* network. The device, tor example a ^^^jj^ £S£ on the amount of information avail- 
works as a handheld " e ' work browse ^ «mitatk>ns of the handheld 
able to the user, except restnct.ons m the form part f n the information seeking, by brows.ng 
40 device. At the same time, however, the user « requested ^^^£Jd fora more personalized media access. 
theWeb.Asthemoderninformationseekert^ 

rn^rr^r.^^ 

lectively. . . rhanne | S in Windows 98, originally developed for the 

[0007] A third approach relates to "channels . e.g. Act.ve Channels n v. connectjon . A cnann el is a kind of 
Lme, user who is no, constant* connected, in order ^^^^J^Z^. the user requests this 
subscription of a media content, such as a "^^^a minLum of disturbance of the user's 

media content to be downloaded ;o the client wh.le the user » o"J.ne ^ is avajlable f rom a Cent 

other on-going Internet communicat.on. Then, ^^^^^^ on handheld devices, and then offers 
memory device (e.g. the hard disc). The channe « n ' ^X^Lna.ized by e.g. cookies, thereby making 

a se.ecTed media content to the user. The '^^^^^^^^ 1S that aihough the user is given a 
the media experience even more opt.m.zed A ^T^^^Z information. No matter how personalized 

~~ - — d ,or no purpose> 

XSI^S^i-n. ■" all media information delivery over a permanent mobile link, is the risk o, date- 
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rioration of the connection quality. This can occur when a car enters a tunnel, or when a moving person is located in 
between the zones of different cells in a cellular network (e.g. GPRS). If the line quality decreases, normal browsing 
can be tediously slow, making a satisfying media experience difficult. 

[0009] Additionally, in order to play back the media content the user's hardware device (e.g. a PC or a handheld 
device) must include a media player supporting the specific media format. The media player is a computer program 
running on the hardware device, e.g. an MP3 player. If the media player does not support the media format, the user 
will not be able to benefit from the download, causing unnecessary cost in terms of connection capacity. 
[0010] The media content is typically stored as a sequence of data bits, a file, formatted according to a pre-defined 
standardized data format, e.g. WAV or MP3. The file typically contains one and only one media content clip, e.g. a 
song, together with some very limited information about the media content itself, e.g. title, artist and genre. 
[0011] The media content is typically played clip-by-clip, i.e. one file is selected and opened in the media player (the 
clip is played) and when the end of the file is reached the audio clip (e.g. the song) is finished. In order to play the next 
clip, the clip has to be selected and started explicitly. Some media players support a playlist concept where the clips 
can be played in a certain pre-defined order but these playlists are extremely limited, as they can only express a linear 
(one dimensional) sequence of clips. Furthermore, there exists no standard data format to define a playlist. 
[0012] Some of the above problems have been addressed by MPEG (Moving Picture Expert Group), and are men- 
tioned in the report MPEG-21 Multimedia Framework, Beijing, 2000. 



Summary of the invention 

20 

[0013] A general object of the present invention is to overcome some of the above problems, and to offer a user a 
satisfying media experience. 

[0014] A further object of the invention is to accomplish a satisfying media experience to a low cost, i.e. to avoid 
unnecessary downloading of media contents to a media player. 

25 [0015] These objects are achieved by a method of type mentioned by way of introduction, comprising the steps of 
defining a personalized media package structure, communicating a first package having said personalized media pack- 
age structure to the client, receiving status information from the client, said status information describing a user action, 
adapting said personalized media package structure in response to said consumption behavior, and communicating 
a second package having said adapted personalized media package structure to the client. 

30 [0016] According to the invention, the user can experience a highly personalized media playback, with a minimum 
of costs related to network transmission. By the implementation of the status information communication to the per- 
sonalization server, the media package structure is continually updated in accordance with the user's consumer pattern, 
i.e. if the user selects to playback media of a certain type on a subject, the structure will be adapted to include more 
media objects of this type on all subjects currently included in the users personal profile. As a result, more media 

35 contents related of this type is downloaded to the personalization server from the one or several content providers. 
However, it is only if and when the user by navigation requests media of this type that the media contents is transferred 
to the client. Therefore, the user will only pay for requested media contents. At the same time, however, the media 
contents that the user requests by navigating, will always be adapted to the user's media consumer pattern, and thus 
the user will have a highly relevant and satisfying media experience without excessive browsing. 

*o [0017] The second package can preferably, in response to user action, include playable media subjects, organized 
according to said adapted personalized package structure. The different packages may therefore differ both in structure 
and in content. This enables media transfer which is highly adaptable to user media consumption behavior. 
[001 8] The status information can further include an indication of the currently available network transmission speed, 
and wherein media subjects unsuitable for the available transmission speed are replaced or excluded from said pack- 

* 5 age. The replacement can according to one approach consist of a conversion of media format, such as a compression 
to a higher degree, resulting In lower quality but less number of bytes. 

[001 9] By adapting the transmitted media contents to the available transmission speed, excessive delays at the client 
are avoided. During periods when the transmission speed is lower than usual, wideband media contents (e.g. video 
clips, audio files with high sampling rates) are retained at the personalization server. The user will thus have a signif- 
icantly reduced media experience, but this is normally a better alternative than having the media content transmission 
completely halted by deteriorating network capacity. 

[0020] The status information can further include an indication of the media formats supported by the client media 
player, and wherein media subjects having a format not supported by said media player are replaced or excluded from 
said package. By communicating to the personalization server information about the client and the client media player, 
> 5 the media contents transmitted to the client can be further adapted. For example, when using a media player not 
capable of playback of video clips (e.g. a mp3-player without display), transmission of such media contents would be 
a waste of connection cost. 

[0021] The status information can further include an indication of the type of situation the user is currently in. Espe- 
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ability to consume med the client hardware and software are significantly similar. 

S Ano IZ aspSt of the invention are devices comprised in the network, inc.uding means for performing the 
^mo^^Z***. methods. These devices can form part of a fixed data network (e.g. the internet) or of a 

10 Io0241 "Another aspect of the invention are computer program products, comprising software code portions for 
ErJninqlhJ Method according to the invention, when said product is run on a computer. Such computer program 
produTarJ ^USS, directly loadable into the interna, memory of a computer, and can for example be disputed 
over a network or on a digital information carrier such as a CD. 

15 Brief description of the drawings 

[0025] Further aspects of the invention wil. be described in the following, with reference to a preferred embodiment. 

20 |So27] Fig 2 is a block diagram of a media distribution network in which the invention is apphcab.e. 

100281 Rq 3 is a publisher node according to the invention. i„„ Mt i„„ • 

0029 Fig 4 is an example of a media package structure according to an embodiment of the .nvent.on. 

[0030] Fig 5 is another illustration of the media package structure in fig 4. 

[0031 ] Fig 6 is a personalization node according to the invention. 

25 [0032] Fig 7 is a navigator according to the invention. 

Detailed description of a preferre d embodiment 

relation between the media subjects and the navigation structure of a media package. In the preferred em 

50 the structure is implemented as an XML Data Translation Definition. 

100371 As shown in fig 4, the clips in a media package 10 are organized in a number of content proper p 

Lnanne.s (CH 1 ,..). e.g. CNN Sport or MTV Top 25. A channel contains a number o, subjects £ ^ 

clip or a song, and each subject can have a number of associated subjects (1 .1.1,...). e.g. related sport ne 

aive more detailed or related information about the subject. hroadcast 

55 ^038, • The subjects have a predefined playback order (1.1, 1.2, 13 etc), and are ,n this way s.m.lar tc a b^dcasr 
However, the multilevel structure allows a move into a parallel path; changing the broadcast to, e.g. 1 .2.1 . -2^. 

So039] A subject can ateo be assigned an expiration tag, making it obsolete after a certain time. This expiration tag 
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can be used throughout the system, to avoid delivering media contents that are "out of date". 

[0040] As shown in fig 5, each subject also contains a number of media representation layers, e.g. text, audio and 
picture. The layers enable the same news clip to be represented in different ways, making it possible to choose from 
different representations in a suitable way, depending on circumstances such as the capability of the media player, the 

5 access capacity or the user's choice. This process will be further described below. 

[0041] Within a layer the media content is further divided into sequences organized and synchronized according to 
a timeline. Sequences are the smallest pieces of a media package and are equivalent with the media files of today, e. 
g. MP3 files. Combining and synchronizing sequences on different layers allows rich media shows to be produced. For 
example, today's news channels on TV often build up their news clips by combining sequences of audio and still pictu res 

10 that change based on the news content. These news clips could be produced based on the media package format 
described above. 

[0042] The lowest layer in fig 5 t the function layer, allows subject dependent interactive functions to be included in 
the subject and also to be synchronized with other sequences. As an example, while listening to a news clip, a menu 
related to the news clip can appear, allowing items of choice to be saved (archived) on the media player for future use 
1 5 or purchased directly from the content provider. 

[0043] Part of an XML file associated with fig 4-5 could look like the example below. 

< CHANNEL name= ' CHI ' > 
20 < SUBJECT id='l.l' 

< LAYER type=' audio '...> 

< SEQUENCE start ='0.30' stop='1.30' f ile= ' al . mp3 ' /> 
25 </ LAYER > 

</SUBJECT> 
<SUBJECT id='1.2'> 

30 

</ CHANNEL > 

< CHANNEL name='CH2' > 
35 </ CHANNEL > 



[0044] Returning to fig 3, a publisher node 1 includes a database 11, and means 12 for connection to the Internet. 
The node 1 is further provided with software 13 for structuring the media contents in the way described above. A media 
content provider, such as a news-station or TV-channel, employ media editors 14 to produce media contents in the 
form of subjects of different types in the database 11. The software 13, possibly with the aid of the media editors 14, 
creates packages 1 0 with the XML structure mentioned above and these packages 1 0 are then made public, i.e. moved 
to a public memory location 1 5 of th e database 1 1 which is available over the Internet. Typically, a package 1 0 is created 
for every channel that the media content provider distributes. 

[0045] Additionally, the publisher node includes means 1 6 for local management functions like setting up and main- 
taining user groups and new personalization node connections, controlling media editor access, backup routines etc. 
[0046] The publisher node can have means for connection with an external content database 17, where additional 
media contents can be found. This can be for example a publicly available database, or a database to which the media 
content provider has access. 

[0047] An intermediate node 4 according to a preferred embodiment is illustrated in fig 6, and includes a personali- 
zation component 5 and a feeder component 6. These two components both provide personalization service to the 
end user but have somewhat different functions and are therefore separated in this description. As the feeder compo- 
nent 6 is closely related to the communication with the mobile network, it is preferably also realized physically separated 
from the personalization component 5, which can be for example a permanently connected Internet server. 
[0048] The personalization component 5 is easily embodied as an Internet portal with open std interfaces 21 and 
thereby accessible from any kind of browser (HTML, WAP, VoiceXML). The personalization component 5 includes a 
user database 22, where user profiles as well as status information about the user consumption behavior are stored, 



5 



NSDOCID: <EP 11B7485A1_I_> 



EP 1 187 485 A1 



10 



15 



20 



and a content provider database 23 inc.uding the content providers and th e categories of media contents that they 
the interlace 24 in order to set up new channels or update contents of ex.st.ng channels . 

heade. or the like. The corresponding use, pronte is teo.lled horn the user proINo database 22. and the paokage .s 
SST «»X« P «.h e pother node, the p..ena, te a, l onoo m po < ,en,5 l nc 1U de Sm ean,27,o„ooa, 

from where it can influence the personalization of media packages at an earl.er stage. Thus a more efficient pers 
alization is accomplished, with a continuous feedback from the user. 

[0055] The status information from the client can also include vanous technical factors, such as. 

40 • connection capacity (speed, etc) 

• memory capacity of the user device 

» processing capacity of the user device 

• available software components of the user device 

• traffic volume 

[0056, Thesefactorspermltthesoftwaretoadapttheme 

es This adaptation can include adjusting the contents in the packages in terms of volume q ^ 
exampTe, when a client is unable to display moving graphics, such media contents w.H ^^^^^ff!S^ 
and when a client has poor memory and/or processor capacity, audio files may be transformed to a lower quality. These 
adapted media packages are then sent to the client using the cx>mmunicat.on means^ _ . 
100571 It should be noted that the technical factors above have sl.ghtly different character. For example 
Sable software components normally are constant during a session, 

can change continuously. Another category of factors can be referred to as ^^^^^^J. 
what the user is doing (e.g. riding a bus or driving a car), and can be expected to change a few tones . d ur.ng a 

[0058} The feeder node can addrtionally include software 26 for .oca. management functions l.ke setting up 
maintaining user groups, new personalization node connections and backup routine^ g 
[0059] A client 3 according to a preferred embodiment ,s illustrated m f.g 7. The client « a nandheia 
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PDA or cellular communication device, and preferably a GPRS/UMTS enabled device. The client software controls 
reception of media packages from the network, and stores the packages locally on the device. The client software also 
holds functionality for navigation in and seamless playback of the packages. In fig 7, the software components refer- 
enced 41 are characteristic for the invention, and referred to as the navigator. The other components are resident in 

5 a default device of the mentioned kind. Obviously, the navigator 41 includes interfaces with the clients software platform 
42, its different software components 43 (e.g. media players), its local memory 44, and its t/O-unit 45. 
[0060] The navigator 41 includes means 46 to control the l/O-unit 45 to download media packages 31 from the feeder 
6, and means 51 to regularly poll the media package status at the feeder 6. When a channel is extended by the content 
provider, the previously downloaded media package structure will be somewhat obsolete, and the polling serves to 

10 update the structure. Downloaded media content is stored in the media package structure or in a normal sequential 
format in the local memory 44 of the device. 

[0061] The navigator further includes means 47 to parse the media package structure, means 48 to navigate in the 
structure, and means 49 to control playback functionality in terms of user interaction (buttons, voice) and players (start, 
stop, skip forward and backward, pause). This part of the navigator is basically a user interface, easily developed by 
*5 the skilled man and adapted to the software on the intended device. 

[0062] The navigator software also includes means 50 to monitor and communicate status information of the type 
mentioned above in relation to the feeder. The information is preferably pushed to the feeder, as it normally reflects 
changes occurring on the client side. 

[0063] The function of the described system is briefly as follows, with reference to fig 8. A user establishes an account 
20 60 with a service provider and defines a profile 61 which is communicated to the intermediate node. The selected 
channel(s) are then transferred 62 to the client in the form of one or several personalized media packages 63 having 
structure but no or very few subjects. This structure is regularly updated through a polling process. When the user 
desires to consume media, the structure is initialized 64, and status information is communicated 65 to the feeder. In 
response to this status information, the personalized structure is adapted 66, and a new, updated package, including 
25 a few subjects, is sent 67 to the client. The subjects are played in their predefined order, unless the user selects a 
different path in the structure. Such a user action 68 will prompt the download of a new media package, containing 
subjects in this area of the structure. In this way, the user experiences a dynamic broadcast. 

[0064] The nodes described above can be conventional type severs, including standard OS and software for main 
process handling. The different described software components of the nodes can be realized by the skilled man without 
30 greater difficulties. Standard network protocols and languages can be used for transfer of files as well as synchroni- 
zation and control data between different nodes. Handling of the databases in the nodes can also be accomplished 
with conventional techniques. 

[0065] The invention lies not in the detailed development of the software components, but rather in the design of the 
general methods allowing the existing network technology to be used in an optimal way to give the user a satisfying 
35 media experience. 



Claims 

*o 1 . Method for providing media content to a user over a digital network, which media content is provided by a media 
content server, organized and selected by an intermediate node in accordance to previously stored user prefer- 
ences, and delivered to a client operated by the user, 
characterized by the steps of 

45 defining a personalized media package structure, 

communicating a first package having said personalized media package structure to the client, 
receiving status information from the client, said status information describing a user action, 
adapting said personalized media package structure in response to said user action, and 
communicating a second package having said adapted personalized media package structure to the client. 

50 

2. Method for receiving media contents to a client from an intermediate node in a digital network, which media content 
is provided by a media content server, organized and selected by said intermediate node in accordance to previ- 
ously stored user preferences, 

characterized by the steps of 



55 



receiving a first package having a personalized media package structure.. 

communicating status information to the intermediate node, said status information describing a user action, 
and 
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receiving a second package having an adapted personalized package structure. 

replaced or excluded from said package. 

player are replaced or excluded from said package. 
6. Method according to any one of Cairns 3-5, wherein said status information further inc.udes an indication of the 

15 type of situation the user is currently in. 
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ences, and delivered to a client operated by the user, 
characterized by means for 

Mg ^^^^^^^ ^ StrUCtUre l ° * e 

30 ously stored user preferences, 

characterized by means for 

receiving a second package having an adapted personalized package structure. 

9. Computer program product, comprise software code portions for performing the steps of claim 1 . when said 
product is run on a computer. 

10. Computer program product, comprising software code portions for performing the steps of claim 2, when said 
product is run on a computer. 
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